From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior (SAB96), pp. 285-

نویسندگان

  • David S. Touretzky
  • Lisa M. Saksida
چکیده

Instrumental (or operant) conditioning, a form of animal learning, is similar to reinforcement learning in that it allows an agent to adapt its actions to gain maximally from the environment while only being rewarded for correct performance. But animals learn much more complicated behaviors through instrumental conditioning than robots presently acquire through reinforcement learning. We describe a new computational model of the conditioning process; our discussion focuses on a training technique called chaining. Four aspects of our model distinguishit from simple reinforcement learning: conditional reinforcers, shifting reinforcement contingencies, explicit action sequencing, and state space refinement. We apply our model to a task commonly used to study working memory in rats and monkeys: the DMTS (Delayed Match to Sample) task. Animals learn this task in stages. Our model also acquires the task in stages, in a similar manner. We have also used our learning program to control a B21 robot.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

From Sab90 to Sab94 : Four Years of Animat Research

Jean-Arcady Meyer and Agn es Guillot Groupe de BioInformatique Ecole Normale Sup erieure, CNRS-URA 686 46, rue d'Ulm. 75230 Paris Cedex 05, France ([email protected] [email protected]) To appear in Cli , Husbands, Meyer and Wilson (Eds.). From Animals to Animats 3. Proceedings of the Third International Conference on Simulation of Adaptive Behavior. The MIT Press/Bradford Books. Abstract Th...

متن کامل

A Hierarchical Classiier System Implementing a Motivationally Autonomous Animat

Autonomous Animat Jean-Yves Donnart and Jean-Arcady Meyer Groupe de BioInformatique Ecole Normale Sup erieure, CNRS-URA 686 46, rue d'Ulm 75230 Paris Cedex 05, France ([email protected] [email protected]) SAB94. From Animals to Animats III. Brighton, UK. August 8-12, 1994. Proceedings of the Third International Conference on Simulation of Adaptive Behavior. D. Cli , P. Husband, J.A. Meyer a...

متن کامل

On the Influence of Sensor Morphology on Vergence

In the field of developmental robotics, a lot of attention has been devoted to algorithms that allow agents to build up skills through sensorimotor interaction. Such interaction is largely affected by the agent’s morphology, that is, its shape, limb articulation, as well as the position and density of sensors on its body surface. Despite its importance, the impact of morphology on behavior has ...

متن کامل

Simulations of Adaptive Behavior in Animats Agn

This paper reviews various architectures or working principles that enable animats i e simulated animals or animal like robots to display adaptive behaviors and that might be useful within the context of computer animation

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999